Convergence of Numerical Method for Multistate Stochastic Dynamic Programming
نویسنده
چکیده
Convergence of corrections is examined for a predictorcorrector method to solve Bellman equations of multi-state stochastic optimal control in continuous time. Quadratic costs and constrained control are assumed. A heuristically linearized comparison equation makes the nonlinear, discontinuous Bellman equation amenable to linear convergence analysis. Convergence is studied using the Fourier stability method. A uniform mesh ratio type condition for the convergence is results. The results are valid for both Gaussian and Poisson type stochastic noise. The convergence criteria has been extremely useful for solving the larger multi-state problems on vector supercomputers and massively parallel processors.
منابع مشابه
A Multi-Stage Single-Machine Replacement Strategy Using Stochastic Dynamic Programming
In this paper, the single machine replacement problem is being modeled into the frameworks of stochastic dynamic programming and control threshold policy, where some properties of the optimal values of the control thresholds are derived. Using these properties and by minimizing a cost function, the optimal values of two control thresholds for the time between productions of two successive nonco...
متن کاملA Defined Benefit Pension Fund ALM Model through Multistage Stochastic Programming
We consider an asset-liability management (ALM) problem for a defined benefit pension fund (PF). The PF manager is assumed to follow a maximal fund valuation problem facing an extended set of risk factors: due to the longevity of the PF members, the inflation affecting salaries in real terms and future incomes, interest rates and market factors affecting jointly the PF liability and asset p...
متن کاملA computational wavelet method for numerical solution of stochastic Volterra-Fredholm integral equations
A Legendre wavelet method is presented for numerical solutions of stochastic Volterra-Fredholm integral equations. The main characteristic of the proposed method is that it reduces stochastic Volterra-Fredholm integral equations into a linear system of equations. Convergence and error analysis of the Legendre wavelets basis are investigated. The efficiency and accuracy of the proposed method wa...
متن کاملSolving a Two-Period Cooperative Advertising Problem Using Dynamic Programming
Cooperative advertising is a cost-sharing mechanism in which a part of retailers' advertising investments are financed by the manufacturers. In recent years, investment among advertising options has become a difficult marketing issue. In this paper, the cooperative advertising problem with advertising options is investigated in a two-period horizon in which the market share in the second period...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کامل